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Digital Divide Problem ... Orthogonal 
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Data Rods: A Simple Solution for Bridging the 


Digital Divide 


Original Data Archive 
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One variable 
one grid point 
all time steps 
per file 


Reorganized Data Archive 
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More than 324,000 time steps 
(37 years) plotted in ~ 1 second 
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GRIB File 


Input file: Multi- 
variable, onetime 
step per file 






Global Level 3 (Gridded) Single Variable 
NASA Earth Science Data 
To 

Time Series ("Data Rods") 

Using NCO, NetCDF, and Giovanni 


F. Files for previous years: Stored across 
several file systems (for parallel I/O) as 
separate, month-long, global lat-lon data 
cubes, with 3 rd dimension along time 

=1 


e.q., last 4 years of data 
lat=42.5, lon=-124.9 
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A. Client (e.g., HydroDesktop 
sends data request 
with spatial-temporal 


constraints 
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H. NCO concatenates all the 
responses. Custom software 
delivers resulting single time 
series as ASCII, WaterMLl, 
WaterML2, or plot 



Data cubes 


Files for previous 
years in Giovanni 
Cache, concatenated 
into data cubes, and 
stored in other file 
systems 
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C. Files for current year: 
Stored in Giovanni Cache 
as single variable, single 
time-step, global lat-lon 
layers, updated as new 
data become available 

GIOVANNI 

I. Archived data, subset 
by variable, converted to 
"fast file" format, and 
stored in Giovanr 
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Generation Time for TRMM 1 On-the- 



1 year 
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tropical Rainfall Measuring Mission 


2 Tiling: Dividing the data set grid into subgrids 
(e.g., Yu tiling for TRMM divides its global grid 
into 4 equal subgrids). 


ges - DISC 

Goddard Earth Sciences 
Data Information Services Center 


Teng, W., H. Rui, R. Strub, and B. Vollmer. Optimal 
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Data Rods Metrics 


2013-01-01 to 2015-11-30 


Product 
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75,271,910 

54,613 

Users: Number of distinct users 

FTP: Get data rods via FTP 

WEB_LDAS: Access data rods in ASCII or as Time Series plot via GES DISC Web services 

Other protocols: Access data rods via CUAHSI HIS (HydroDesktop) 
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Summary and Ongoing Work 


• Developed operational way to reorganize data that is 
optimal for user communities that are point-time series 
oriented. 

• Solved the motivating problem presented by CUAHSI HIS: 
create time series of hourly data, for single grid cells for 
entire period of coverage. 

• Key to all solutions is to reorganize data that is optimal for 
desired method of data access. 

• Ongoing investigation into tiling of data set grids has 
yielded results that are very encouraging for significantly 
reducing the generation time for data rods. 


GES - DISC 

Goddard Earth Sciences 
Data Information Services Center 


Extras 
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Data Rods 


http://disc.sci.gsfc.nasa.gov/hvdrology/data- 

rods-time-series-data 
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Data Rods 
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https://www.arcgis.com/home/webmap/viewer 
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